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(54) Signal processing method and circuit for format conversion of picture signal 



(57) In order to carry out a format conversion or a 
scaling processing on a picture signal by a memory of 
small capacity, interlace scanning picture signals are 
converted into progressive scanning picture signals by 
interpolation by using an IP converter 1 and a multiple- 
scan converter 3. Scaling processing by expansion and 
compression in the horizontal direction is firstly per- 
formed by using a horizontal scaling unit 5, processing 
by expansion, compression, frame rate conversion, syn- 

FIG. 



chronisation and the like are secondly performed by 
using a vertical scaling unit 6 and commonly using 
memories used in scaling processing in the vertical 
direction, and finally, colour space conversion or inverse 
gamma processing is performed by using a picture 
quality improving unit 8 thereby converting the picture 
signals into picture signals S6 having a predetermined 
format. 
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Description 

BACKGROUND OF THE INVENTION 

The present invention relates to signal processing 
of format conversion of picture signal, particularly to a 
method and a circuit for signal processing of format con- 
version of picture signal preferable to converting a plu- 
rality of kinds of formats of picture signals into picture 
signals of predetermined display formats of picture out- 
put devices or conversion of flexible compression and 
flexible expansion of pictures in a horizontal and a verti- 
cal direction, or the like. 

In recent years, with progress in multimedia, in 
respect of picture signals, kinds and modes of pictures 
to be handled increase rapidly and are advancing in a 
direction of diversification. Further, in respect of picture 
output devices for displaying pictures, other than CRT 
(Cathode Ray Tube), planar displays such as a liquid 
crystal display device, a plasma display panel and the 
like have frequently been used. Therefore, it is indispen- 
sable for information terminal devices in correspond- 
ence with multimedia to be provided with a function of 
receiving many kinds and many modes of picture 
sources and displaying them. 

As representative methods for realizing the func- 
tion, there are known a method of dealing with by dis- 
play and a method of dealing with by signal processing. 
According to the former method, a picture is displayed 
by widely setting an operational range of a deflection 
system of a picture output device and performing a 
scanning operation in a mode in compliance with a sig- 
nal format of input pictures, which has been reduced 
into practice as multi scan system. Although this is an 
effective method which can be realized at a compara- 
tively low cost when a display unit is a CRT. it is difficult 
to apply in a planar display such as a liquid crystal dis- 
play device, a plasma display panel or the like having a 
constant number of display picture elements. 

According to the latter method, format conversion is 
performed by signal processing and pictures are dis- 
played by converting inputted signals of pictures into 
signals of display formats of picture output devices, 
which can be applied to all the picture output devices 
such as a CRT, a liquid crystal display device, a plasma 
display panel and the like. Therefore, this is a method 
that is extremely effective in dealing with diversification 
of input picture sources or picture output devices pre- 
dicted in the future. According to the method, various 
signal processing such as conversion of frame rate, 
compression and expansion of picture size and the like 
must be performed for format conversion. 

For example, when a television signal of PAL sys- 
tem is converted into a television signal of NTSC sys- 
tem and displayed by a CRT or a liquid crystal display 
device, signal processing such as conversion of frame 
rate, conversion of number of scanning lines, conver- 
sion from interlace scanning into progressive scanning, 



conversion of aspect ratio or the like, compression and 
expansion, synchronizing and the like are performed 
independently each other Further, memories having a 
comparatively large capacity such as a line memory, a 

5 frame memory are used in many of these signal 
processing operations. Accordingly, conventionally, a 
number of memories are needed in a total of signal 
processing and device cost is increased by using many 
memories. Further, a variety of input and output inter- 

w faces are needed between signal processing and there- 
fore, processing for matching interfaces are often 
needed, which amounts to an increase in device cost 

Further, in each of signal processing, picture quality 
is slightly deteriorated, which is caused by, for example, 

15 quantization error by AD/DA conversion, band restric- 
tion by subjecting signals to a filter or the like. Such a 
picture quality deterioration is accumulated at each sig- 
nal processing and the picture quality deterioration can- 
not be disregarded. 

20 

SUMMARY OF THE INVENTION 

It is a principal object of the present invention to 
provide a method and a circuit for signal processing of 

25 format conversion of picture signal where deterioration 
of picture quality accompanied by signal processing of 
format conversion is inconsiderable, used memory 
capacity is extremely small and a reduction in fabrica- 
tion cost is facilitated. 

30 It is other object of the present invention to achieve 
the above object as well as to provide a signal process- 
ing circuit capable of converting a plurality of kinds of 
systems of input picture signals into signals of predeter- 
mined display formats of picture output devices. 

35 In order to achieve the above-described object, 
according to an aspect of the present invention, there is 
provided a circuit for signal processing of format conver- 
sion of picture signal, comprising a scanning convenor 
for converting an input picture signal into a picture sig- 

40 nal of progressive scanning when the input picture sig- 
nal is of interlace scanning, a selector for selecting 
either one of the input picture signal and the picture sig- 
nal of progressive scanning outputted from the scan- 
ning convertor, a scaling unit for performing signal 

45 processing of scaling in horizontal and vertical direc- 
tions in respect of an output signal from the selector for 
format conversion and a control unit for selecting 
parameters of signal processing in accordance with a 
format of the input picture signal and a display format of 

so a picture output device and controlling at least the scan- 
ning convertor, the selector and the scaling unit in 
accordance with the parameters of the signal process- 
ing. 

Such a constitution is realized by commonly using 
55 memories in some signal processing, unifying combina- 
tions among signal processing by a common digital 
interface and a common signal system (progressive 
scanning system) and adopting a centralized control by 
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the control unit. 

Deterioration in picture quality is significantly 
improved by combining respective signal processing by 
signals of progressive scanning system. That is. many 
filtering processing are performed for picture signals in s 
signal processing. In respect of many filters needed in 
such a picture processing, when progressive scanning 
system is compared with interlace scanning system, the 
degree of freedom of design is larger in the progressive 
scanning system and the filters can be realized with 
substantially ideal characteristics having high spatial 
frequencies. Therefore, deterioration in picture quality 
accompanied by signal processing in format conversion 
is significantly improved. 

The scaling unit is provided with a horizontal scal- 
ing unit performing signal processing of the horizontal 
scaling and a vertical scaling unit performing signal 
processing of the vertical scaling. When a number of 
inputted horizontal picture elements of the input picture 
signal is larger than a number of horizontal picture ele- 
ments of a displayed picture, the horizontal scaling is 
performed preferably prior to the vertical scaling and in 
the converse case, the vertical scaling is preferably per- 
formed prior to the horizontal scaling. Further, in the 
vertical scaling, other than signal processing of com- 
pression and expansion, also at least one of signal 
processing of frame rate conversion for system conver- 
sion (for example, PAL-NTSC conversion) of TV signals, 
signal processing for PAL 100 Hz, and signal process- 
ing of synchronization in multi windows such as double 
windows, a PIP (Picture In Picture; a small sub picture 
is displayed in a full main picture) display or the like, is 
performed. According to the constitution, compared with 
the case where signal processing of system conversion, 
compression, expansion, synchronization and the like 
are independently performed, a memory capacity nec- 
essary for signal processing of format conversion can 
significantly be reduced to one severalth of field (several 
mega bits). 

Further, the circuit structure of each of horizontal 
scaling and vertical scaling is constituted by a combina- 
tion of a calculation unit for multiplying a plurality of pic- 
ture elements or picture elements of a plurality of lines 
by coefficient values, memories and a plurality of num- 
bers of switches by which compression function, expan- 
sion function and through function are realized by 
switching signals by selectively controlling the switches. 
According to the calculation unit, linear interpolation 
process is performed. A plurality of kinds of processing 
can be performed by a same circuit through the techni- 
cal means by which circuit scale necessary for signal 
processing can significantly be reduced. 

According to a preferable embodiment of the 
present invention, the scanning converter converts the 
input picture signal into a picture signal of progressive 
scanning by motion-adaptive process or motion com- 
pensative interpolation. Also, an output side of the scal- 
ing unit is provided with a picture quality improving unit 



for executing picture quality improving processing such 
as color space conversion or inverse gamma conver- 
sion to the picture signal which has been subjected to 
signal processing of format conversion. 

As other preferable embodiment of the present 
invention, there is provided a multi processing unit for 
performing signal processing of multiplexing a first pic- 
ture signal and a second picture signal of the same sys- 
tem (for example, NTSC television signals of interlace 
scanning) to a time-division multiplex signal during 1 
scanning line period in which signal processing of for- 
mat conversion is performed each for the first picture 
signal in one window and for picture signals outputted 
from the multi -processing unit in double windows. A fur- 
ther reduction in circuit scale necessary for signal 
processing can be achieved through the technical 
means. 

As still other preferable embodiment of the present 
invention, as input picture signals, there are adopted 
component signals of 4:2:0 system comprising lumi- 
nance signals and two color difference signals (a sys- 
tem where two color difference signals are divided to 
every other scanning lines and color signals are sam- 
pled at a rate of 1/2 of that of luminance signal) or 4:2:2 
system (a system where both of two color difference 
signals are present on one scanning line and color dif- 
ference signals are sampled at a rate of 1/2 of that of 
luminance signal). Various sources (for example, 
present TV signal, HDTV (High Definition Television) 
signal, EDTV (Extended Definition Television) signal, 
personal computer picture, package system picture and 
the like) can be processed in a unified manner through 
the technical means. Further, signal processing of two 
color difference signals can be performed by a memory 
capacity substantially the same as in luminance signal 
in the case of 4:2:2 system and a memory capacity of 
1/2 of that of luminance signal in the case of 4:2:0 sys- 
tem. 

Further, as still other preferable embodiment of the 
present invention, when an extremely high-speed oper- 
ation is needed in signal processing (for example, when 
display is a high definition display or the like), a signal of 
progressive scanning is divided into two series of sig- 
nals and signal processing of horizontal and vertical 
scaling for format conversion are performed to the two 
series of the signals. The signal processing can be per- 
formed at 1/2 operational speed through the technical 
means. Incidentally, the memory capacity necessary for 
the signal processing is substantially the same as in one 
series. 

Further, an output side of the scaling unit is pro- 
vided with a picture quality improving unit for executing 
picture quality improving processing such as color 
space conversion, inverse gamma conversion or the like 
in respect of the picture signal which has been sub- 
jected to signal processing of format conversion. 
According to the conventional technology, an accuracy 
of substantially 10 bits/picture element is needed for an 
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output of the picture quality improving processing and 
therefore, it is necessary to adopt the accuracy of 10 
bits/picture element in signal processing at and after the 
picture quality improvement. According to the present 
invention, the process of picture quality improvement is 
arranged after finishing signal processing of format con- 
version and therefore, respective signal processing 
after format conversion can be performed by a normal 
accuracy of 8 bits/picture element and accordingly, 
capacities of memories and circuit scale can be 
reduced. 

These and other objects and many of the attendant 
advantages of the invention will be readily appreciated 
as the same becomes better understood by reference to 
the following detailed description when considered in 
connection with the accompanying drawings. 
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scaling unit 6 of Fig. 1 ; 

Fig. 6E is an outline view of the operation of a mem- 
ory in the case of PAL-NTSC conversion process- 
ing of the vertical scaling unit 6 of Fig. 1 ; 

Fig. 7 is a block diagram of a picture quality improv- 
ing unit 8 of Fig. 1 ; 

Fig. 8 is a view of an embodiment of a TV receiver 
using a format conversion circuit of picture signals 
according to the present invention; 

Fig. 9 is a block diagram of a second embodiment 
of a format conversion circuit of picture signals 
according to the present invention; 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a first embodiment of a 
format conversion circuit of picture signals accord- 
ing to the present invention; 



Fig. 1 0A is a block diagram of a 2 channel division 
unit 53 of Fig. 9; 

Fig. 10B is an explanatory view of the operation of 
the 2 channel division unit 53 of Fig. 9; 



Fig. 2 is a block diagram of an IP convertor 1 of Fig. 

1; 25 

Fig. 3A is a block diagram of a multiple scan conver- 
tor 3 of Fig. 1 ; 

Fig. 3 B is an explanatory view of the operation of 30 
the multiple scan convertor 3 of Fig. 1 ; 

Fig. 4A is a block diagram of a horizontal scaling 
unit 5 of Fig. 1 ; 

35 

Fig. 4B is an explanatory view of the operation of 
the horizontal scaling unit 5; 

Fig. 5A is a block diagram of a vertical scaling unit 
6 of Fig. 1 ; 40 

Fig. 5B is an explanatory view of the operation of 
the vertical scaling unit 6; 

Fig. 6A is an outline view of the operation of a mem- 45 
ory in the case of a vertical compression process- 
ing of the vertical scaling unit 6 of Fig. 1 ; 

Fig. 6B is an outline view of the operation of a mem- 
ory in the case of a vertical expansion processing of so 
the vertical scaling unit 6 of Fig. 1 ; 

Fig. 6C is an outline view of the operation of a mem- 
ory in the case of PAL 100 Hz of the vertical scaling 
unit 6 of Fig. 1 ; 55 

Fig. 6D is an outline view of the operation of a mem- 
ory in the case of NTSC-PAL 100 Hz of the vertical 



Fig. 1 1 A is a block diagram of a vertical scaling unit 
54 of Fig. 9; 

Fig. 1 1 B is an explanatory view of the operation of 
the vertical scaling unit 54 of Fig. 9; 

Fig. 12A is an outline view of the operation of a 
memory in the case of a vertical compression 
processing of the vertical scaling unit 54 of Fig. 9; 

Fig. 12B is an outline view of the operation of a 
memory in the case of the vertical expansion 
processing of the vertical scaling unit 54 of Fig. 9; 

Fig. 12C is an outline view of the operation of a 
memory in the case of PAL 100 Hz of the vertical 
scaling unit 54 of Fig. 9; 

Fig. 12D is an outline view of the operation of a 
memory in the case of NTSC-PAL 100 Hz of the 
vertical scaling unit 54 of Fig. 9; 

Fig. 12E is an outline view of the operation of a 
memory in the case of PAL-NTSC conversion 
processing of the vertical scaling unit 54 of Fig. 9; 

Fig. 13 is a block diagram of a third embodiment of 
a' format conversion circuit of picture signals 
according to the present invention; 

Rg. 14 is a block diagram of a multi processing unit 
66 of Fig. 13; 

Fig. 15A is an outline view of the operation of the 
multi processing unit 66 of Fig. 13 in double win- 
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dows; 

Rg. 15B is an outline view of the operation of the 
multi processing unit 66 of Rg. 13 in PIP display; 

5 



Rg. 22 is an explanatory view of signal processing 
with an object of 625/100/2:1 (aspect 163) display; 
and 

Rg. 23 is an explanatory view of signal processing 
with an object of 1 125/60/2:1 (aspect 16:9) display. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



Rg. 16A is an outline view of signal processing at 
horizontal and vertical scaling units of Rg. 13; 

Rg. 16B is an outline view of vertical synchronizing 
processing of the horizontal and vertical scaling 10 
units of Rg. 13; 

Rg. 16C is an outline view of the operation of a 
memory in the vertical synchronizing processing at 
the horizontal and vertical scaling units of Fig. 13; is 

Fig. 1 7 is a block diagram of a fourth embodiment of 
a format conversion circuit of picture signals 
according to the present invention; 

20 

Rg. 1 8 is an outline view of signal processing of PIP 
display at a multi processing unit 73 of Fig. 1 7; 

Fig. 19A is a view of picture where a format is con- 
verted into horizontal compression (normal mode); 25 

Fig. 19B is a view of picture where a format is con- 
verted into vertical expansion (cinema mode); 

Fig. 1 9C is a view of picture where a format is con- 30 
verted into smooth wide; 

Fig. 19D is a view of picture where a format is con- 
verted into squeeze (full mode); 

35 

Rg. 19E is a view of picture where a format is con- 
verted into horizontal and vertical flexible compres- 
sion; 

Fig. 19F is a view of picture where a format is con- 40 
verted into horizontal and vertical flexible expan- 
sion; 

Fig. 20A shows an equation of 4-3 line number con- 
version in Fig. 1 ; 45 

Rg. 20B shows an equation of 3-4 line number con- 
version in Fig. 1 ; 

Fig. 20C shows an equation of 6-5 line number con- so 
version in Fig. 1 ; 

Fig. 20D shows an equation of 5-6 line number con- 
version in Fig. 1 ; 

55 

Fig. 21 is an explanatory view of signal processing 
with an object of 525/60/1:1 (aspect 16:9) display; 



(Embodiment 1) 

Rg. 1 is a block diagram showing a first embodi- 
ment of a format conversion signal processing circuit of 
picture signals according to the present invention. A 
detailed explanation will be given later of detailed struc- 
tures of respective blocks in reference to drawings of 
numerals designating the blocks. 

An Input picture signal S1 (comprising component 
luminance and color difference signals of 4:2:2 system 
or 4:2:0 system or the like) is inputted to an IP converter 
1 and a selector 4. The IP converter 1, constituting a 
first converter which is the front stage of the scanning 
converter, forms a signal of scanning lines skipped in 
interlace scanning by motion-adaptive process or 
motion compensative interpolation in respect of the 
input picture signal of interlace scanning, and outputs a 
transmission scanning line signal SM transmitted in 
interlace scanning and an interpolation scanning line 
signal SI formed by the above-described interpolation. 
A multiple scan converter 3, constituting the back stage 
of the scanning converter, performs signal processing of 
1/2 compression of time axis in the horizontal direction 
and time-division multiplex in respect of the signals SM 
and SI respectively and outputs a picture signal SP of 
progressive scanning. Thus the scanning converter is 
formed with the IP convenor 1 and the multiple scan 
converter 3. 

A selector 4 is constituted by a switch circuit for 
selecting the signal SP when the input picture signal S1 
is the present television (hereinafter, abbreviated as TV) 
signal of interlace scanning and the input picture signal 
S1 when the input picture signal S1 is an EDTV signal, 
a personal computer picture signal or a HDTV signal of 
progressive scanning, respectively and outputting the 
signal Si or the signal SP as a signal S2. 

A horizontal scaling unit 5 inputs the signal S2 of 
progressive scanning outputted from the selector 4, per- 
forms signal processing for converting K picture ele- 
ments into L picture elements in respect of the 
horizontal direction of the picture (hereinafter, abbrevi- 
ated as horizontal K-L conversion), and performs hori- 
zontal expansion (K<L) or horizontal compression (K>L) 
and outputs a converted signal S3. A vertical scaling 
unit 6 performs signal processing for converting K scan- 
ning lines into L scanning lines in respect of the vertical 
direction of the picture (hereinafter, abbreviated as ver- 
tical K-L conversion) and performs vertical expansion 
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(K<L) or vertical compression (K>L). Further, depend- 
ing on the input signals S1. system conversion (for 
example, system conversion between PAL system and 
NTSC system), signal processing of synchronization 
and signal processing of PAL 1 00 Hz when the field f re- s 
quency of display is 100 Hz, are also performed. Fur- 
ther, a picture signal S4 with the format of which is 
converted, are outputted. Further, it is preferable in view 
of simplifying signal processing to provide the horizontal 
scaling unit 5 on the input side of the vertical scaling unit 
6 when horizontal compression (K>L) is performed and 
provide the horizontal scaling unit 5 on the output side 
of the vertical scaling unit 6 when horizontal expansion 
(K<L) is performed. 

A picture quality improving unit 8 inputs the picture 
signal S4 outputted from the vertical scaling unit 6 that 
is the final stage of format conversion, performs signal 
processing of picture quality improvement such as black 
stretching, white stretching or the like of luminance sig- 
nals, color space conversion and the like and converts 
them into RGB signals of three primary colors. Further, 
signal processing of inverse gamma conversion is per- 
formed when a display is a linear property display. Fur- 
ther, a three primary colors picture signal S5 is 
outputted. A conventionally known one may be used for 
the picture quality improving unit 8. 

A multiplex unit 9 performs signal processing for 
multiplexing another three primary colors picture signal 
S7 for multi pictures displaying (for example, double 
windows, PIP display, multi windows or the like) in 
respect of the signal S5. Further, a picture signal S6 in 
conformity with a format of a display is outputted. 

A microprocessor unit 10 sets signal processing 
parameters based on a picture format signal SPI (infor- 
mation of kind of input picture signals S1 , format of dis- 
play, mode of picture display and the like) and controls 
the respective blocks 1 , 3, 4, 5, 6, 8 and 9. The picture 
format signal SPI is automatically detected from a frame 
number, synchronization signal and the like of the input 
picture signal S1 and from the picture output device at a 
detector 0. The picture format signal SPI may naturally 
be generated manually. 

A control unit 1 1 forms synchronization signal, con- 
trol signal, dock signal and the like necessary for signal 
processing at the respective blocks and supplies them 
to the respective blocks. Further, information SD neces- 
sary for synchronizing processing in multi windows is 
outputted. That is, a control unit for generally controlling 
the respective blocks is constituted by the microproces- 
sor unit 10 and the control unit 11. 

An explanation will be given of the constitution of 
the principal blocks of Fig. 1 as follows. 

Fig. 2 is a view of a constitution example of the IP 
converter 1 and a memory 2 of Fig. 1. Motion-adaptive 
interpolation is performed. The circuit is substantially 
the same as a conventionally known circuit. 

A portion of luminance signal S1 (Y) of the input pic- 
ture signal S1 is outputted as a luminance signal SM(Y) 



of the transmission scanning line signal SM. Meanwhile, 
an interpolation signal suitable for moving picture is 
formed by adding at an adder 1 3 a signal delayed by 1 H 
period at an 1H delay unit 12 (notation H designates a 
period of horizontal scanning line which remains the 
same in the following explanation) and multiplying a 
coefficient value 1/2 at a coefficient product unit 14. 

Further, an interpolation signal suitable for station- 
ary picture is formed by a signal delayed by 1 field 
period at a field memory FD1 in the memory 2. Further, 
a signal formed by delaying the signal by 1 field period 
at other field memory FD2, is subtracted at a subtracter 
1 7 by which a differential signal at an interval of 1 frame 
is detected. A motion coefficient setting unit 18 sets a 
motion information coefficient having a value from 0 to 1 
in accordance with an absolute value of the differential 
signal, that is, a magnitude of motion of picture. A MAX 
selecting unit 1 9 sets a final motion coefficient K by also 
using motion information of previous 1 field to avoid 
motion detection miss. That is. a maximum value is 
detected between a signal of motion of previous 1 field 
formed by delaying a signal at a field memory FD3 that 
are multiplied by a coefficient a (0<a<1) at a coefficient 
product unit 20 and the motion information coefficient, 
and the maximum value is outputted as the final motion 
coefficient K {0<K<A . stationary: K=0). Thus the MAX 
selecting unit 19 constitutes a motion detector. Coeffi- 
cient product units 15 multiply the interpolation signal 
suitable for moving picture and the interpolation signal 
suitable for stationary picture by coefficients K and 1 -K 
respectively, and an adder 16 forms a luminance signal 
SI(Y) of the interpolation scanning line signal SI by add- 
ing the both multiplied signals. 

In respect of a color difference signal S1 (C) of the 
input picture signal S1. interpolation signals are formed 
by intrafield interpolation. That is, the signal S1(C) is 
outputted as a color difference signal SM(C) of the 
transmission scanning line signal SM, and a color differ- 
ence signal SI(C) of the interpolation scanning line sig- 
nal SI is formed by adding a signal delayed by 1 line 
period in a 1 H delay unit 12 to the color difference signal 
S1(C) at an adder 13 and multiplying the outputted sig- 
nal from the adder by a coefficient value 1/2 at a coeffi- 
cient product unit 14. 

Incidentally, the bandwidth of each of two color dif- 
ference signals u and v comprising the color difference 
signal S1(C) inputted to the above-described IP conver- 
ter 1 and selector 4 is 1/2 of the bandwidth of the lumi- 
nance signal S1(Y). Therefore, when the input picture 
signal S1 is of 4:2:2 system, two sets of the circuit hav- 
ing the bandwidth of nearly 1/2 of the bandwidth of the 
luminance signal S1(Y) are prepared for processing the 
two signals u and v. For example, the circuit of the 
above-described IP converter 1 has such a constitution. 
However, the circuit for the color difference signal S1 (C) 
is not limited thereto but one set of a circuit can be pre- 
pared by using a color signal multiplex unit which multi- 
plexes the two signals u and v into a time-division 
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multiplex color signal. In this case, the bandwidth of the 
time-division multiplex color signal becomes double and 
nearly the same as the bandwidth of the luminance sig- 
nal S1(Y). Therefore, the circuit for processing the time- 
division multiplex color signal forms one set of the circuit 
having nearly the same as the bandwidth of the lumi- 
nance signal S1(Y). Thereby, the circuit for processing 
the time-division multiplex color signal can be simplified 
by reducing the number of circuits. The time-division 
multiplex color signal outputted from the color signal 
multiplex unit is inputted to the IP converter 1 and the 
selector 4. 

Fig. 3A and Fig. 3B are a view of the constitution of 
a multiple scan convenor 3 of Fig. 1 and a view for 
explaining the function of a line memory 21 of Fig. 3 A, 
respectively. 

The signals SM(Y) and SM(C) of the transmission 
scanning line signal SM are stored to line memories 21 - 
1 respectively and the signals SI(Y) and SI(C) of the 
interpolation scanning line signal SI are stored to tine 
memories 21 -2 respectively for 1 line period at an oper- 
ational speed of interlace scanning by a write operation 
(hereinafter, abbreviated as WT operation) shown by 
Fig. 3B. 

According to a read operation (hereinafter, abbrevi- 
ated as RD operation) from the line memories, the line 
memories 21-1 and 21-2 are alternately read in 1 line 
period (l/2fH) (1/2 time period of interlace scanning) 
successively at the operational speed of progressive 
scanning. Further, the signals from the line memories 
21-1, 21-2 are multiplexed time-sequentially at a multi- 
plex unit 22 and a luminance signal SP(Y) and a color 
difference signal SP(C) of the signal SP of progressive 
scanning are provided as outputs thereof. 

Fig. 4A and Fig. 4B are a view showing the consti- 
tution of the horizontal scaling unit 5 of Fig. 1 and a view 
showing signal processing parameters for performing 
selective control of switches in various signal process- 
ing, respectively. 

According to signal processing of compression in a 
horizontal direction (hereinafter, abbreviated as hori- 
zontal compression), output lines of switches 24(SW1), 
28(SW2) and 31(SW4) are connected to terminals "a" 
and an output line of a switch 30 (SW3) is connected to 
a terminal "b". A luminance signal S2(Y) of the signal S2 
of progressive scanning is subjected to band restriction 
by low pass frequency characteristic at a horizontal LPF 
23 to remove horizontal high frequency components 
constituting an aliasing noise in compression process- 
ing. Next, linear interpolation process of horizontal K-L 
conversion (K>L) of picture elements is performed at a 
calculation unit constituted by a 1 picture element delay 
unit 25, coefficient product units 26 and an adder 27. 
That is, an input signal to the delay unit 25 and a signal 
delayed by 1 picture element by the delay element 25 
are respectively multiplied by coefficient values p and 1 - 
p (1>p£0) at the coefficient product units 26 and the 
both are added at the adder 27 thereby providing a sig- 
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nal of L picture elements formed from K picture ele- 
ments by the horizontal K-L conversion. Further, the 
coefficient values p and 1 -p are changed at the respec- 
tive picture elements with K picture elements as a 

5 period. The signal of L picture elements is stored to a 
1 H memory 29 by intermittent WT operation. Further, a 
signal from the memory 29 is read continuously by RD 
operation. A signal S3(Y) of the signal S3 which has 
been subjected to horizontal compression by a muttipli- 

io cation factor of UK is provided as the output from the 
switch 31 . 

According to signal processing of expansion in a 
horizontal direction (hereinafter, abbreviated as hori- 
zontal expansion), the output lines of the switches 

is 24(SW1) and 28(SW2) are connected to terminals "b" 
and the output lines of the switches 30(SW3) and 
31(SW4) are connected to the terminals "a". The lumi- 
nance signal S2(Y) of progressive scanning is continu- 
ously stored to the 1 H memory 29 by WT operation. 

20 Further, in RD operation, repetition RD operation is per- 
formed at portions of period and a signal of K of picture 
elements is read in a period of L picture elements. Lin- 
ear interpolation process of K-L conversion (K<L) of pic- 
ture elements is performed by the calculation unit 

25 constituted by the 1 picture element delay unit 25, the 
coefficient product units 26 and the adder 27. That is, an 
input signal to the delay unit 25 and a signal delayed by 
1 picture element at the delay unit 25 are multiplied by 
the coefficient values p and 1 -p at the coefficient prod- 

30 uct units 26 and the both are added at the adder 27 
thereby providing a signal of L picture elements formed 
from K picture elements by K-L conversion. Incidentally, 
the coefficient values p and 1-p are changed at the 
respective picture elements with L picture elements as a 

35 period. A signal S3(Y) of the signal S3 which has been 
subjected to horizontal expansion by a multiplication 
factor of UK is provided as the output from the switch 31 
(SW4). Further, as mentioned above, in respect of sig- 
nal processing of horizontal expansion, it is preferable 

40 to provide the horizontal scaling unit 5 on the output 
side of the vertical scaling unit 6. 

Through processing is performed when horizontal 
compression or expansion is not needed in which the 
switch 31 is connected to the terminal "d" and the input 

45 signal S2(Y) is provided at the output of the switch 31 as 
a signal S3(Y) of the signal S3 which has not been sub- 
jected to compression or expansion processing. 

Also in respect of a color difference signal S2(C) of 
the signal S2 of progressive scanning, signal process- 
so ing by the constitution the same as in the case of the 
luminance signal S2(Y) is performed thereby providing 
a color difference signal S3(C) the signal S3 which has 
been subjected to horizontal compression, horizontal 
expansion or through. 

55 Fig. 5A and Fig. 5B are a view showing the consti- 
tution of the vertical scaling unit 6 of Fig. 1 and a view 
showing signal processing parameters of selective con- 
trol of switches in various signal processing, respec- 
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tivety. According to signal processing of compression in 
a vertical direction (hereinafter, abbreviated as vertical 
compression), output lines of switches 33(SW1), 
37(SW2) and 39(SW4) are connected to terminals "a - 
and an output line of switch 38(SW3) is connected to a 5 
terminal "b", respectively. The luminance signal S3(Y) of 
picture signal of progressive scanning is subjected to 
band restriction of low pass frequency characteristic at 
a vertical LPF 32 to remove vertical high frequency 
components constituting an aliasing noise in compres- w 
sion processing. Linear interpolation process of vertical 
K-L conversion (K>L) of lines is performed by a calcula- 
tion unit constituted by a 1 line delay element 34, coeffi- 
cient product units 35 and an adder 36. That is, an input 
signal to the memory unit 34 and a signal delayed by 1 15 
line at the memory unit 34 are multiplied by coefficient 
values p and 1 -0 at the coefficient product units 35 and 
the both are added at the adder 36 thereby providing a 
signal of L lines formed from K lines by vertical K-L con- 
version as the output. Incidentally, the coefficient values 20 
p and 1-p are changed at the respective lines with K 
lines as a period. As shown by Fig. 6A, at a memory M- 
1 in a memory 7, WT operation and RD operation are 
performed with 1 field period as a period. In WT opera- 
tion, the signal formed by vertical K-L conversion is 25 
intermittently written and stored. Meanwhile, in RD 
operation, a signal from the memory M-1 is read contin- 
uously from time point delayed by ( 1-L/K) field period. 
Thus, a signal S4(Y) of the signal S4 which has been 
subjected to vertical compression by a multiplication 30 
factor of UK is provided as the output from the switch 39 
(SW4). As memory capacity necessary for signal 
processing of vertical compression as described above, 
a capacity for ( 1 -UK ) field period is sufficient. 

According to signal processing of expansion in a 35 
vertical direction (hereinafter, abbreviated as vertical 
expansion), the output lines of the switches 33(SW1) 
and 37(SW2) are connected to the terminals "b" and the 
output lines of the switches 38(SW3) and 39(SW4) are 
connected to the terminals "a", respectively. In the 40 
memory M-1 , WT operation and RD operation are per- 
formed with 1 field period as one period as shown by 
Fig. 6B. The luminance signal S3(Y) of progressive 
scanning is stored continuously by WT operation. 
Meanwhile, with respect to RD operation, repetition RD 45 
operation is performed at portions of period and a signal 
of L lines is read in a period of K lines. Next, linear inter- 
polation process of vertical L-K conversion (L<K) of 
lines is performed by the calculation unit constituted by 
the 1 line delay element 34, the coefficient product units so 
35 and the adder 36. That is, an input signal to the 
memory unit 34 and a signal delayed by 1 line at the 
memory unit 34 are multiplied by the coefficient values 
p and 1 -p at the coefficient product units 35 and the both 
are added at the adder 36 thereby providing a signal of ss 
K lines formed from L lines by L-K conversion as the 
output. Incidentally, the coefficient values p and 1-p are 
changed at the respective lines with K lines as a period. 



Thus, a signal S4(Y) of the signal S4 which has been 
subjected to vertical expansion at a multiplication factor 
K/L is provided as the output from the switch 39(SW). 
As memory capacity necessary for signal processing of 
vertical expansion as described above, a capacity of 
( 1 -L7K ) field period is sufficient. 

Signal processing of PAL 100 Hz is for converting a 
signal having the field frequency of 50 Hz to a signal of 
interlace scanning of 100 Hz (hereinafter, abbreviated 
as 625/100/2:1) to remove flickers of PAL television sys- 
tem converted into progressive scanning (hereinafter, 
abbreviated as 625/50/1:1). The processing is realized 
by connecting the output lines of the switches 37(SW2) 
and 38(SW3) to the terminals "b" and connecting the 
output line of the switch 39(SW4) to the terminal "a". In 
the memory M-1 , WT operation and RD operation as 
shown by Fig. 6C are performed. The luminance signal 
S3(Y) of the PAL signal of progressive scanning is con- 
tinuously stored by WT operation with 1 field period as a 
period. Meanwhile, in RD operation, a signal from the 
memory M-1 is read in the order of a signal of odd 
number scanning lines of progressive scanning (desig- 
nated by Q-Q in Fig. 6C) and a signal of even number 
scanning lines (designated by 0* E in Fi 9- 6C) from 
time point delayed by 0.5 field period. Thus, a signal 
S4(Y) of the signal S4 of PAL 100 Hz is provided as the 
output from the switch 39(SW4). As memory capacity 
necessary for signal processing of PAL 100 Hz 
described above, the capacity of 0.5 field period is suffi- 
cient. 

According to signal processing of NTSC-PAL 100 
Hz, a NTSC signal converted into progressive scanning 
(hereinafter, abbreviated as 525/60/1:1) is converted 
into a signal of 625/100/2:1 system. The processing is 
realized by connecting the output lines of the switches 
33(SW1) and 37(SW2) to the terminals "b", the output 
line of the switch 38(SW3) to a terminal "c" and the out- 
put line of the switch 39(SW4) to the terminal "a", 
respectively. As shown by Fig. 6D. the luminance sig- 
nals S3(Y) of the NTSC signal of progressive scanning 
is stored continuously to the memory M-1 by WT opera- 
tion with NTSC 1 field period as a period. Meanwhile, in 
RD operation, repetition RD operation is performed at 
portions of period with PAL 1 field period as a period by 
which a signal of 5 lines is read in a time period of 6 
lines. 

Next, vertical expansion is performed by linear 
interpolation process of 5-6 line number conversion by 
the calculation unit constituted by the 1 line memory unit 
34, the coefficient product units 35 and the adder 36. 
That is. an input signal to the memory unit 34 and a sig- 
nal delayed by 1 line at the memory unit 34 are multi- 
plied by the coefficient values p and 1-p at the 
coefficient product units 35 and both are added at the 
adder 36 thereby providing a signal of 6 lines formed 
from 5 lines by 5-6 line number conversion as the out- 
put. Incidentally, the coefficient values p and 1-p are 
changed at the respective lines with 6 lines as a period. 
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At a memory M-2 of the memory 7, the signal outputted 
from the adder 36 and supplied to the memory M-2 is 
stored continuously by WT operation with PAL 1 field 
period as a period. Meanwhile, in RD operation, a signal 
outputted from the memory M-2 is read in the order of a 
signal of odd number scanning lines (O"0 in Fig. 6D) 
and a signal of even number scanning lines (O'E in 
Fig. 6D) from time point delayed by 0.5 field period. 
Thus, a signal S4(Y) of the signal S4 of NTSC-PAL 100 
Hz is provided as the output from the switch 39(SW4). 
As memory capacity necessary for signal processing of 
NTSC-PAL 100 Hz as described above, a capacity of 1 
field period for NTSC-PAL conversion and 0.5 field 
period for field multiple scan conversion is sufficient. 

According to signal processing of PAL-NTSC con- 
version, a signal of 625/50/1 :1 system is converted into 
a signal of 525/60/1:1 system in which the output lines 
of the switches 33(SW1) and 37(SW2) are connected to 
the terminals "a", the output line of the switch 38(SW3) 
is connected to the terminal "b" and the output line of 
the switch 39(SW4) is connected to the terminal "a", 
respectively. The luminance signal S3 00 of PAL system 
of progressive scanning is subjected to band restriction 
by low pass frequency characteristic at the vertical LPF 
32. Next, vertical compression is performed by linear 
interpolation process of 6-5 line number conversion by 
the calculation unit constituted by the 1 line memory unit 
34, the coefficient product units 35 and the adder 36. 
That is, an input signal to the memory unit 34 and a sig- 
nal delayed by 1 line at the memory unit 34 are multi- 
plied by the coefficient values 0 and 1-p at the 
coefficient product units 35 and both are added at the 
adder 36 thereby providing a signal of 5 lines formed 
from 6 lines by 6-5 line number conversion as the out- 
put. Incidentally, the coefficient values p and 1-p are 
changed for the respective lines with 6 lines as a period. 
As shown by Fig. 6E, at the memory M-1 a signal 
formed by 6-5 line number conversion is intermittently 
written and stored by WT operation with PAL 1 field 
period as a period. Meanwhile, a signal outputted from 
the memory M-1 is read in RD operation with NTSC 1 
field period as a period. Thus, a signal S4(Y) of the sig- 
nal S4 which has been subjected to PAL-NTSC conver- 
sion is provided as the output from the switch 39(SW4). 
As memory capacity necessary for signal processing of 
PAL-NTSC conversion as described above, a capacity 
of 1 field period is sufficient. 

Through processing is performed when processing 
of vertical compression or expansion is not needed in 
which the output line of the switch 39(SW4) is con- 
nected to the terminal "b" and a signal S4(Y) of the sig- 
nal S4 which has not been subjected to processing of 
compression or expansion is provided as the output 
from the switch 39. 

Also in respect of the color difference signal S3(C) 
of picture signal of progressive scanning, signal 
processing by the constitution the same as in the lumi- 
nance signal is performed thereby providing a signal 



S4(C) of the signal S4 of vertical compression, vertical 
expansion, PAL 100 Hz, NTSC-PAL 100 Hz, PAL-NTSC 
conversion or through processing. Incidentally, the 
parameters and the coefficients of signal processing for 

5 driving the switches in Fig. 4A, Fig. 4B and Fig. 5A and 
Fig. 5B are provided from the microprocessor of Fig. 1 . 
The same goes with other embodiments shown below. 

As described above, according to the vertical scal- 
ing unit, various signal processing necessary for format 

io conversion can be carried out with an extremely small 
memory capacity. 

Fig. 19A through Fig. 19F show pictures of repre- 
sentative examples in format conversion of picture sig- 
nal. In Fig. 19 A, a picture is horizontally compressed to 

is display a picture of aspect ratio of 4:3 on a display 
screen of aspect ratio of 16:9, which is referred to as 
normal mode. In Fig. 19B, a picture is vertically 
expanded to display a letter box picture in a screen of 
aspect ratio of 16:9, which is referred to as cinema 

20 mode. In Fig. 19C, the left and right corner areas of a 
picture of aspect ratio of 4:3 are gradually expanded 
and are displayed in a full screen of aspect ratio of 16:9, 
which is referred to as smooth wide. In Fig. 19D, picture 
of aspect ratio of 4:3 compressed horizontally is dis- 
ss played in a full screen of aspect ratio of 16:9, which is 
referred to as full mode. In Fig. 19E, picture is displayed 
by compressing in the horizontal and the vertical direc- 
tions by an arbitrary magnification. Further, in Fig. 19F, 
picture is displayed by expanding in the horizontal and 

30 vertical directions by an arbitrary magnification (referred 
to as zoom mode). 

Fig. 20A through Fig. 20D show equations of repre- 
sentative processing of K-L conversion used in signal 
processing of format conversion. 

35 4-3 conversion of Fig. 20A is used in normal mode. 
A matrix shown in Fig. 20 A indicates a corresponding 
relationship between 4 points of input series X1 . X2, X3 
and X4, and 3 points of output series Y1, Y2 and Y3. 
Therefore, in the above-described calculation unit, the 

40 coefficient values (p. 1-p) are changed to (1, 0), (2/3, 
1/3), (1/3, 2/3) thereby forming the output series. 3-4 
conversion of Fig. 20B is used in cinema mode. A matrix 
in Fig. 20B indicates a corresponding relationship 
between 4 points of input series X1 , X2, X3 and X4 (inci- 

45 dentally, X4 is used also for X1 of next input series), and 
4 points of output series Y1. Y2, Y3 and Y4. Therefore, 
in the above-described calculation unit, the coefficient 
values (p. 1-p) are changed to (0, 1), (1/4, 3/4), (2/4, 
2/4), (3/4, 1/4) thereby forming the output series. Fur- 

50 ther, Fig. 20C shows an example of 6-5 conversion used 
in PAL-NTSC conversion and Fig. 20D shows an exam- 
ple of 5-6 conversion used in NTSC-PAL conversion. 

Fig. 21 shows signal processing at the IP converter 
1, the horizontal and vertical scaling units 5 and 6 with 

55 an object of display of a picture signal (526/60/1 :1) and 
aspect ratio of 16:9. In Fig. 21 . circle mark in IP conver- 
sion represents an operation of carrying out IP conver- 
sion. 
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In respect of the input signal S1 of 525/60/2:1 sys- 
tem (corresponding to present NTSC system), format 
conversion in correspondence with various display 
modes is carried out to the signal converted to progres- 
sive scanning at the IP convertor 1. 

In respect of the input signal S1 of 525/60/1 1 sys- 
tem (corresponding to EDTV system), the IP conversion 
is not carried out since it is progressive scanning and 
through processing, expansion and compression are 
carried out in accordance with display modes. 

In respect of the input signal S1 of 1125/60/2:1 sys- 
tem (corresponding to HDTV) 17-16 conversion is car- 
ried out at the vertical scaling unit 6 and the input signal 
is converted from interlace scanning to progressive 
scanning. Further, processing of expansion and com- 
pression are carried out in accordance with display 
modes. 

In respect of the input signal S1 of 625/50/2:1 sys- 
tem (corresponding to present PAL system), frame rate 
conversion and 6-5 line number conversion are carried 
out at the vertical scaling unit 6 to the signal converted 
into progressive scanning at the IP convertor 1. Also, 
format conversion in correspondence with various dis- 
play modes is carried out. 

The input signal S1 of PC system (personal compu- 
ter picture) is of progressive scanning of 60 frames/sec- 
ond and therefore, the IP conversion is not carried out 
and processing of normal mode display is performed at 
horizontal and vertical scaling units 5 and 6. That is, in 
VGA system (640x460). horizontal 4-3 line number con- 
version is performed, in SVGA system (800x600), hori- 
zontal 4-3 line number conversion and vertical 5-4 line 
number conversion are performed and in XGA system 
(1024x768), horizontal 4-3 line number conversion and 
vertical 8-5 line number conversion are performed. 

Fig. 22 shows signal processing at the IP convertor 
1 , the horizontal and the vertical scaling units 5 and 6 
with an object of display of 625/100/2:1 and aspect ratio 
of 16:9. 

In respect of the input signal S1 of 525/60/2:1 sys- 
tem (corresponding to present NTSC system), frame 
rate conversion, 5-6 line number conversion and field 
multiple scan conversion are performed at the vertical 
scaling unit 6 to the signal converted into progressive 
scanning at the IP convertor 1 . Also, format conversion 
in correspondence with various display modes is per- 
formed. 

In respect of the input signal S1 of 525/60/1 :1 sys- 
tem (corresponding to EDTV system), the IP conversion 
is not carried out since it is progressive scanning and 
frame rate conversion, 5-6 line number conversion and 
field multiple scan conversion are performed at the ver- 
tical scaling unit 6. Further, processing of through, 
expansion and compression are performed in accord- 
ance with display modes. 

In respect of the input signal S1 of 1 125/60/2:1 sys- 
tem (corresponding to HDTV), frame rate conversion, 
15-16 line number conversion and field multiple scan 



conversion are performed at the vertical scaling unit 6. 
Further, processing of expansion and compression are 
performed in accordance with display modes. 

In respect of the input signal S1 of 625/50/2:1 sys- 

5 tern (corresponding to present PAL system), field multi- 
ple scan conversion is performed at the vertical scaling 
unit 6 to the signal converted into progressive scanning 
at the IP convertor 1. Further, format conversion in cor- 
respondence with various display modes is performed. 

w The input signal of PC system (personal computer 
picture) is of progressive scanning of 60 frames/second 
and therefore, the IP conversion is not carried out and 
frame rate conversion and field multiple scan conver- 
sion are performed at the vertical scaling unit 6. Further, 

75 processing for normal mode display is performed. That 
is, in VGA system (640x480), horizontal 4-3 line number 
conversion and vertical 5-6 line number conversion are 
performed, in SVGA system (800x600), horizontal 4-3 
line number conversion is performed and in XGA sys- 

20 tern (1024x768), horizontal 4-3 line number conversion 
and vertical 4-3 line number conversion are performed. 

Fig. 23 shows signal processing at the IP convertor 
and the horizontal and vertical scaling units with an 
object of display of 1 125/60/2:1 and aspect ratio of 16:9. 

25 In respect of the input signal S1 of 525/60/2:1 sys- 
tem (corresponding to present NTSC system), format 
conversion in correspondence with various display 
modes is carried out to the signal converted into pro- 
gressive scanning at the IP convertor 1. Further, 16-17 

30 line number conversion is also carried out at the vertical 
scaling unit 6 and the signal inputted to the unit 6 is con- 
verted into a signal of interlace scanning. 

In respect of the input signal S1 of 525/60/1 :1 sys- 
tem (corresponding to EDTV system), the IP conversion 

35 is not carried out since it is progressive scanning and 
processing of through, expansion and compression are 
performed in accordance with display modes. Inciden- 
tally, 16-17 line number conversion is also carried out at 
the vertical scaling unit 6 and the signal inputted to the 

40 unit 6 is converted into a signal of interlace scanning. 

In respect of the input signal S1 of 1 125/60/2:1 sys- 
tem (corresponding to HDTV), processing of expansion 
and compression are carried out in accordance with dis- 
play modes. 

45 In respect of the input signal S1 of 625/50/2:1 sys- 
tem (corresponding to present PAL system), frame rate 
conversion and 16-15 line number conversion are car- 
ried out at the vertical scaling unit 6 to the signal con- 
verted into progressive scanning at the IP convertor 1 

so and the signal inputted to the unit 6 is converted into a 
signal of interlace scanning. Also, format conversion in 
correspondence with various display modes is per- 
formed. 

The input signal of PC system (personal computer 
55 picture) is of progressive scanning of 60 frames/second 
and accordingly, the IP conversion is not performed and 
a processing of normal mode display is performed at the 
horizontal and vertical scaling unit 5 and 6. That is, in 
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VGA system (640x480), horizontal 4-3 line number con- 
version and vertical 16-17 line number conversion are 
performed, in SVGA system (800x600). horizontal 4-3 
line number conversion and vertical 20-17 line number 
conversion are performed and in XGA system 
(1024x768). horizontal 4-3 line number conversion and 
vertical 32-21 line number conversion are performed. 

Next, Fig. 7 shows an example of the constitution of 
the picture quality improving unit 8 of Fig. 1 . Hie lumi- 
nance signal S4(Y) of picture signal, which has been 
subjected to format conversion processing, is inputted 
to a luminance processing unit 74 where signal 
processing of image enhancer, black stretching and 
white stretching are carried out. Further, the color differ- 
ence signal S4(C) of picture signal which has been sub- 
jected to format conversion is inputted to a picture 
element interpolation unit 75 where signal processing 
for demodulating the color signal S4(C) into color differ- 
ence signals U and V having the structure of sample 
point the same as in the luminance signal. A color space 
convertor 76 carries out conversion processing from a 
luminance and color difference system to a three pri- 
mary colors RGB system. Further, an inverse gamma 
processing unit 77 carries out signal processing of 
inverse gamma correction for a display having a linear 
characteristic. A selector 78 selects a signal from the 
color space convertor in a display having a gamma 
characteristic as in CRT or the like and selects a signal 
from the inverse gamma processing unit 77 in a display 
having a linear characteristic as in a liquid crystal dis- 
play device or a plasma display panel and outputs them 
as three primary color image signals S5. 

As mentioned in the above embodiment, according 
to the present invention, a method and a circuit for sig- 
nal processing of format conversion of picture signal 
having inconsiderable deterioration of picture quality 
accompanied by signal processing and an extremely 
small memory capacity for use at low cost, can be real- 
ized. 

Further, Fig. 8 shows an embodiment of a television 
receiver using a circuit for signal processing of format 
conversion of picture signal according to the embodi- 
ment. Respective blocks shown in Fig. 8 and a picture 
output device (not illustrated) are integrated into a tele- 
vision receiver. A conventionally known one may be 
used for the picture output device. 

Terrestrial broadcast wave is received by a UV 
tuner 40 and demodulated into a picture signal of base 
band. Satellite broadcast wave is received by a BS/CS 
tuner 41 and is demodulated into a picture signal of 
base band. Further, a switcher 42 selects and outputs 
one from the demodulated picture signals and picture 
signals of the package (CD-ROM, video tape) systems. 

A present system decoder 43 performs signal 
processing of YC (luminance and color) separation and 
color demodulation in respect of a picture signal of 
NTSC system or PAL system and demodulates the sig- 
nal into luminance and color difference signals of com- 



ponent 45:2 system (or 45:0 system). An ED/HD 
decoder 44 performs signal processing of demodulation 
in respect of a picture signal of ED TV system or HDTV 
system and demodulates the signal into luminance and 

5 color difference signals of progressive scanning in 
EDTV system or component 4:2:2 system (or 4:2:0 sys- 
tem) of interlace scanning in HDTV system. 

Digital broadcast wave is received by a digital 
receiver 45 and is demodulated into a bit stream signal 

10 by performing signal processing of d esc ramble, error 
correction and the like. The bit stream signal is demod- 
ulated into luminance and color difference signals of 
component 4:2:2 system (or 4:2:0 system) by perform- 
ing demodulation processing at an MPEG decoder 46. 

is A PC picture signal (three primary colors RGB sig- 
nal) is inputted to a PC processing unit 47 and con- 
verted into luminance and color difference signals of 
component 45:2 system (or 4:2:0 system) by perform- 
ing signal processing of color space conversion to lumi- 

20 nance and color difference system. 

A switcher 48 selects and outputs these signals. 
A picture processing unit 49-1 performs signal 
processing of converting a picture signal into a format of 
a display in the format conversion signal processing cir- 

25 cuit of picture signals shown by Fig. 1 . In one window 
mode, a signal from the picture processing unit 49-1 is 
outputted and in multi windows mode, signals formed by 
multiplexing the signal from the picture processing unit 
49-1 as a main picture with a signal as a sub picture 

30 from a picture processing unit 49-2 where synchronizing 
with the main picture is carried out by the information 
SD. 

A multiplex unit 51 performs processing of multi- 
plexing on screen pictures formed by OSD (On Screen 

35 Display) 50 (means for forming small other picture in 
one picture in case of forming pictures of personal com- 
puter or the like) to the signal, supplies the output signal 
to a picture output device (not illustrated in the draw- 
ings). In the picture output device, the picture whose for- 

40 mat is converted to a predetermined display format is 
displayed. 

A microcomputer control unit 52 sets the input sig- 
nals or display modes, controls signal processing at 
respective blocks and the like. Incidentally, connections 

45 between the microcomputer control unit 52 and the 
respective blocks are omitted. 

As mentioned above, by adopting the format con- 
version signal processing circuit of the present inven- 
tion, a television receiver for receiving and displaying 

so picture signals from various input sources can be real- 
ized at low cost by reducing necessary memories. Inci- 
dentally, in respect of the picture processing unit 49. it 
may also be constituted in a second through a fourth 
embodiment mentioned below. Further, in the following 

55 explanation of embodiments, the same numerals are 
attached to constitutions or function portions substan- 
tially the same as those in the first embodiment and an 
explanation thereof will be omitted. 
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(Embodiment 2) 

Fig. 9 shows a second embodiment of a format con- 
version signal processing circuit of picture signal 
according to the present invention. According to the s 
embodiment, signal processing at horizontal and verti- 
cal scaling units is performed under a state of two series 
of signals of interlace scanning and thereafter, the sig- 
nals are converted into a signal of progressive scan- 
ning. That is. an input picture signal is divided into two 
series and signal processing of horizontal and vertical 
scaling units is performed to each of the divided signals. 

The input picture signal S1 (comprising component 
luminance and color difference signals of 4:2:2 system 
or 4:2:0 system) is inputted to the IP convertor 1 and a 
2 channel division unit 53. The IP convertor 1 operates 
to the input picture signal S1 of interlace scanning and 
is provided with the constitution and operation the same 
as those shown by Fig. 2. The 2 channel division unit 53 
forms two series of signals SM' and SI' of interlace 
scanning from the input picture signal S1 of progressive 
scanning. The 2 channel division unit constitutes a sec- 
ond convertor. The selector 4 selects respectively the 
signals SM and SI when the input picture signal Si is 
the present TV signal of interlace scanning and the sig- 
nals SM* and SI' when the signal S1 is the EDTV signal, 
the personal computer picture signal or the HDTV signal 
of progressive scanning and outputs the selected sig- 
nals as signals S2M and S2I. 

The horizontal scaling units 5 perform horizontal 
expansion (K<L) or horizontal compression (K>L) by 
signal processing of horizontal K-L conversion for each 
of the signals S2M and S2I and output signals S3M and 
S3) expanded or compressed in the horizontal direction. 
A vertical scaling unit 54 performs vertical expansion 
(K<L) or vertical compression (K>L) by signal process- 
ing of vertical K-L conversion to the signals S3M and 
S3I. Further, depending on the kind of the input signal 
S1 , similar to Embodiment 1 , signal processing of sys- 
tem conversion (for example, PAL-NTSC conversion) or 
synchronization is performed and depending on a dis- 
play, signal processing of PAL 100 Hz is performed 
along therewith. Further, signals S4M and S4I the for- 
mat of each of which is converted are outputted. 

The multiple scan convertor 3 performs signal 
processing of 1/2 compression of time axis and time- 
division multiplex in the horizontal direction for each of 
the signals S4M and S4I and outputs a picture signal S4 
of progressive scanning. 

Fig. 10A and Fig. 10B are a block diagram of the 2 
channel division unit 53 of Fig. 9 and a view for explain- 
ing the operation, respectively. 

The luminance signal S1(Y) and the color differ- 
ence signal S1 (C) of the input picture signal S1 of pro- 
gressive scanning are respectively inputted to line 
memories 56-1 and 56-2. As shown by Fig. 10B, the line 
memory 56-1 stores signals (scanning lines ©, 
<§),••• in figure) of scanning lines corresponding to 



first interlace scanning in WT operation for 1 line period 
of fH. Meanwhile, in RD operation, signals are read for 
a time period of 2fH twice as much as that in WT opera- 
tion by which signals SM'(Y) and SM'(C) of interlace 
scanning are provided. 

The line memory 56-2 stores signal (scanning lines 
®,®, • • • in figure) of scanning lines corresponding 
to second interlace scanning in WT operation for 1 line 
period of fH. Meanwhile, in RD operation, signals are 
read for a time period of 2fH twice as much as that in 
WT operation by which signals SI (Y) and SI'(C) of inter- 
lace scanning are provided. 

Fig. 11A and Fig. 11B are a block diagram of the 
vertical scaling unit 54 of Fig. 9 and a view showing the 
operation of selective control of switches in the vertical 
scaling unit 54. 

According to signal processing of vertical compres- 
sion at the vertical scaling unit 54, output lines of 
switches 58(SW1), 63(SW2) and 65(SW4) are con- 
nected to terminals "a" and an output line of the switch 
64(SW3) is connected to a terminal "b", respectively. 
Two series of picture signals of luminance signals 
S3M(Y) and S3 1 (Y) are subjected to band restriction by 
low pass frequency characteristics at a vertical LPF 57 
to remove vertical high frequency components consti- 
tuting an aliasing noise in compression processing. Lin- 
ear interpolation process of vertical K-L conversion 
(K>L) is performed by a calculation unit constituted by a 
1 line delay element 59, coefficient product units 60 and 
adders 61. That is, in one signal way, the signals 
S3M(Y) and S3I(Y) are multiplied by coefficient values 0 
and 1 -p at the coefficient product units 60 and both are 
added at the adder 61 . In the other signal way, a signal 
formed by delaying the signal S3M(Y) by 1 line at the 1 
line delay element 59 and the signal S3I(Y) are multi- 
plied by coefficient values y and 1 -y at the coefficient 
product units 60 and both are added at the adder 61 . 

In this method, two series of signals comprising sig- 
nals of L lines formed from K lines by vertical K-L con- 
version are provided. Incidentally, the coefficient values 
p, 1*p, y and 1 -y are changed at the respective lines. For 
example, in 4-3 line number conversion, the coefficient 
values (p, 1-p) are changed for each line such as (1,0), 
(1/3, 2/3), (2/3, 1/3), (1, 0), • • • , and the coefficient val- 
ues (y, 1 -y ) are changed for each line such as (2/3, 1/3), 
(1 . 0). (1/3. 2/3), (2/3, 1/3). • • • . As shown by Fig. 12A, 
at a memory M1 of a memory 55, WT operation and RD 
operation are performed with 1 field period as a period. 
In WT operation, two series of signals formed by K-L 
conversion are intermittently written and stored. Mean- 
while, in RD operation, two series of signals are contin- 
uously read from time points delayed by ( 1 -UK ) field 
period and two series of signals S4M(Y) and S4I(Y) 
which have been subjected to vertical compression at a 
multiplication factor of UK are provided as outputs of the 
switch 65 (SW4). As memory capacity necessary for 
signal processing of vertical compression described 
above, a capacity of ( 1 -UK ) field period is sufficient. 
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According to signal processing of vertical expan- 
sion, the output lines of the switches 58(SW1) and 
63(SW2) are connected to the terminals "b" and the out- 
put lines of the switches 64<SW3) and 65(SW4) are 
connected to the terminals "a*. As shown by Fig. 1 2B, at 
the memory M1, WT operation and RD operation are 
performed with 1 field period as a period. The lumi- 
nance signals S3M(Y) and S3I(Y) of two series of pic- 
ture signals are continuously stored by WT operation. 
Meanwhile, in RD operation, repetition RD operation is 
performed at portions of period and two series of sig- 
nals of L lines are read in a period of K lines. Linear 
interpolation process of L-K conversion (L<K) of lines is 
performed by the calculation unit constituted by the 1 
line delay element 59, the coefficient product units 60 
and the adders 61 . That is, in one signal way, the signals 
of S3M(Y) and S3I(Y) are multiplied by the coefficient 
values 0 and 1-0 at the coefficient product units 60 and 
both are added at the adder 61 . 

In the other signal way. a signal produced by delay- 
ing the signal S3M(Y) by 1 line at the 1 line delay ele- 
ment 59 and the signals of S3I(Y) are multiplied by 
coefficient values y and 1-y at the coefficient product 
units 60 and both are added at the adder 61 . Two series 
of signals comprising signals of K lines formed from L 
lines by L-K conversion are provided as outputs. Inci- 
dentally, the coefficients values 0, 1-0, y and 1-y are 
changed at the respective lines. For example, according 
to 3-4 line number conversion, the coefficient values (0, 
1 -0) are changed for the respective lines such as (1.0), 
(2/4, 2/4), (1,0), • • • and the coefficient values (y, 1-y) 
are changed for the respective lines such as (1/4, 3/4), 
(3/4, 1/4), (1/4, 3/4) • • • . Further, two series of signals 
S4M(Y) and S4I(Y) which have been vertically 
expanded by a multiplication factor K/L are provided as 
outputs of the switch 65(SW4). As memory capacity 
necessary for signal processing of vertical expansion 
described above, a signal of (1-LVK) field period is suf- 
ficient. 

According to signal processing of PAL 100 Hz, a 
signal of PAL system (625/50/1:1) converted into pro- 
gressive scanning is converted into a signal of PAL 100 
Hz system (625/100/2:1) of interlace scanning of 100 
fields/second, which is realized by respectively connect- 
ing the output lines of SW2 and SW3 to the terminals 
"b" and the output tine of SW4 to the terminal "a". At the 
memory M1, WT operation and RD operation shown by 
Fig. 12C are performed. The luminance signals S3M(Y) 
and S3I(Y) of two series of PAL signals are stored con- 
tinuously in WT operation with 1 field period as a period. 
Meanwhile, in RD operation, signals are read in the 
order of a signal (O-O in figure) and a signal (0" E in 
figure) from time point delayed by 0.5 field period. Fur- 
ther, two series of signals SM4(Y) and S4I(Y) of PAL 
100 Hz are provided as outputs from the switch 
65(SW4). As memory capacity necessary for signal 
processing of PAL 100 Hz described above, a capacity 
of 1 field period is sufficient. 



According to signal processing of NTSC/PAL 100 
Hz, a signal of NTSC system (525/60/1:1) converted 
into progressive scanning are converted into a signal of 
625/100/2:1 system in which the output lines of the 

5 switches 58(SW1) and 63(SW2) are connected to the 
terminals "b". the output line of the switch 64(SW3) is 
connected to a terminal "c" and the output line of the 
switch 65(SW4) is connected to the terminal "a", 
respectively. As shown by Fig. 12D, the luminance sig- 

70 nals S3M(Y) and S3I(Y) of two series of NTSC system 
are continuously stored to the memory M1 by WT oper- 
ation with NTSC 1 field period as a period. Meanwhile, 
in RD operation, repetition RD operation is performed at 
portions of period and two series of signals of 5 lines are 

is read in a period of 6 lines. 

Next, vertical expansion is performed by linear 
interpolation process of 5-6 line number conversion by 
the calculation unit constituted by the 1 line delay ele- 
ment 59, the coefficient product units 60 and the adders 

20 61. That is. in one signal way, the signals S3M(Y) and 
S3I(Y) are multiplied by the coefficient values 0 and 1-0 
at the coefficient product units 60 respectively and both 
are added at the adder 61 . In the other signal way. a sig- 
nal formed by delaying the signal S3M(Y) by 1 line at the 

25 1 line delay element 59 and the signal S31(Y) are multi- 
plied by the coefficient values y and 1 ~y at the coefficient 
product units 60 and both are added at the adder 61. 
Two series of signals comprising signals of 6 lines 
formed from 5 lines by 5-6 line number conversion are 

30 provided as the outputs of addition. Incidentally, the 
coefficient values 0, 1-0, y and 1-y ere respectively 
changed at the respective lines. Signals are stored con- 
tinuously in WT operation to a memory M2 of the mem- 
ory 55 with PAL 1 field as a period. Meanwhile, in RD 

35 operation, signals are read in the order of a signal (O* 
0 in figure) and a signal (Q-E in figure) from time point 
delayed by 0.5 field period. Further, two series of sig- 
nals S4M(Y) and S4I(Y) of NTSC-PAL 100 Hz are pro- 
vided as outputs from the switch 65(SW4). As memory 

40 capacity necessary for signal processing of NTSC-PAL 
100 Hz described above, a capacity of 1 field period for 
NTSC-PAL conversion and 1 field period for field multi- 
plex scan conversion is sufficient. 

According to signal conversion of PAL-NTSC con- 

45 version, a signal of 625/50/1 :1 system is converted into 
a signal of 525/60/1 :1 system in which the output lines 
of the switches 58(SW1) and 63(SW2) are connected to 
the terminals "a", the output line of the switch 64(SW3) 
is connected to the terminal "b" and the output line of 

so the switch 65(SW4) is connected to the terminal "a", 
respectively. The luminance signals S3M(Y) and S3I(Y) 
of two series of PAL system are subjected to band 
restriction by low pass frequency characteristic at the 
vertical LPF 57. Vertical compression is performed by 

55 linear interpolation process of 6-5 line number conver- 
sion of lines at the calculation unit constituted by the 1 
line delay element 59, the coefficient product units 60 
and the adders 61. In one signal way. the signal of 



13 



25 



EPO 837 601 A2 



26 



S3M(Y) and S3l(Y) are multiplied by the coefficient val- 
ues 0 and 1-p at the coefficient product units 60 and 
both are added at the adder 61 . In the other signal way, 
a signal formed by delaying the signal S3M(Y) by 1 line 
at the 1 line delay element 59 and the signal S3I(Y) are 5 
multiplied by the coefficient values y and 1 t at the coef- 
ficient product units 60 and both are added at the adder 
61. Two series of signals comprising signals of 5 lines 
formed from 6 lines by 6-5 line number conversion are 
provided as the outputs. Incidentally, the coefficient val- 
ues p, 1 -p. r and 1 -y are changed at the respective lines. 
As shown by Fig. 12E. at the memory M1. two series of 
signals formed by 6-5 line number conversion are inter- 
mittently written and stored by WT operation with PAL 1 
field period as a period. Meanwhile, in RD operation, 
two series of signals are read with NTSC 1 field period 
as a period. Further, signals S4M(Y) and S4I(Y) which 
have been subjected to PAL-NTSC conversion are pro- 
vided as outputs from the switch 65. As memory capac- 
ity necessary for signal processing of PAL-NTSC 
conversion described above, a capacity of PAL 1 field 
period is sufficient. 

According to through signal processing, the output 
line of the switch 65 is connected to the terminal "b". 
Further, two series of signals S4M(Y) and S4I(Y) which 
have not been subjected to processing of compression 
or expansion are provided as outputs from the switch 
65. 

Also in respect of color signals S3M(C) and S3I(C) 
of two series of picture signals, signal processing hav- 
ing the constitution the same as that in luminance sig- 
nals is performed and two series of signals S4M(C) and 
S4I(C) of vertical compression, vertical expansion, PAL 
100 Hz, NTSC-PAL 100 Hz, PAL-NTSC conversion or 
through processing are provided. 

As described above, according to the vertical scal- 
ing unit 54, various kinds of signal processing neces- 
sary for format conversion can be carried out with an 
extremely small memory capacity. According to the 
embodiment, in respect of a display such as a high def- 
inition display requiring extremely high speed operation 
for signal processing, a method and a circuit for signal 
processing of format conversion of picture signal having 
inconsiderable deterioration of picture quality accompa- 
nied by signal processing and an extremely small mem- 
ory capacity for use can be realized at low cost. 

(Embodiment 3) 

Fig. 13 shows a third embodiment of a format con- 
version circuit of picture signal according to the present 
invention. According to the embodiment, a multi 
processing unit 66 for synthesizing two series of input 
picture signals and a selector 67 are added to the con- 
stitution shown by Fig. 1 , which is preferable in the case 
where both of functions of double windows and PIP dis- 
play are realized. In Fig. 13, portions having the consti- 
tution and function substantially the same as those in 



Fig. 1 are attached with notations the same as those in 
Fig. 1 and a detailed explanation thereof will be omitted. 

A first input picture signal S1 (comprising compo- 
nent luminance and color difference signals of 4:2:2 
system or 4:2:0 system) is inputted to the multi process- 
ing unit 66 and the selector 67. Further, a second input 
picture signal SV (comprising component luminance 
and color difference signals of 4:2:2 system or 4:2:0 
system) is inputted to the multi processing unit 66. 

At the multi processing unit 66, signal processing of 
multiplexing the first and the second picture signals into 
a time-division multiplex signal is carried out by which a 
signal for double windows or PIP display is formed. The 
selector 67 outputs the first picture signal S1 in one win- 
dow mode and a signal from the multi processing unit 
66 in double windows or PIP display mode. 

Fig. 14 is a block diagram showing the constitution 
of the multi processing unit 66, Fig. 1 5A is a view for 
explaining an outline of the operation of the multi 
processing unit in double windows according to the 
embodiment and Fig. 15B is a view for explaining an 
outline of the operation of the multi processing unit in 
PIP display, respectively. 

As shown by Fig. 14, at horizontal LPFs 68, hori- 
zontal high frequency components are removed by low 
pass characteristic to avoid an aliasing noise accompa- 
nied by sub sampling processing. Further, at sub sam- 
pling units 69, signal processing of sub sampling of 2:1 
in double windows and 6:1 in PIP display is performed. 
As mentioned later, selectors 70 select signals of S1 
and S1 * in double windows of cut mode and signals from 
the sub sampling units 69 in the other cases. 

Line memories 71 perform WT operation and RD 
operation shown by Figs. 15A and 15B. Output signals 
from the line memories 71 are subjected to time division 
multiplex at a multiplex unit 72 by which a signal for dou- 
ble windows or PIP display is formed. A detailed 
description will be given of the operation of the line 
memories 71 in reference to Figs. 15A and 15B as fol- 
lows. Both Figs. 15A and 15B show a case where 1 line 
is constituted by 910 picture elements and a number of 
effective picture elements among them is 768. 

Fig. 15A shows the operation of the memories 71 in 
double windows. In cut mode, each of picture signals S1 
and S1 ' is displayed at 3/5 of screen (hatched region in 
figure). Accordingly, in WT operation, signals of 454 pic- 
ture elements shown by dots are stored with 1 line 
period as a period. Incidentally, phases of horizontal 
synchronization are shifted normally between the sig- 
nals S1 and SV. Meanwhile, RD operation is performed 
by a synchronizing system of the signal S1. A signal 
(O l in figure) of the signal S1 is read in a period of 
454 picture elements from the front of 1 line, and a sig- 
nal (0- R in figure) of the signal S1 ' is read in a period 
of successive 454 picture elements. In RD operation, 
horizontal synchronization is performed by which hori- 
zontally synchronized output signals are provided. Inci- 
dentally, although according to the output signals, 
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phases of vertical synchronization are shifted in the sig- 
nals Si and S1\ the shift is corrected by signal process- 
ing of vertical (V) synchronization at a vertical scaling 
unit 6. mentioned later. 

In full mode, full pictures (dot regions in figure) of 5 
the picture signals S1 and SV are displayed respec- 
tively. Therefore, in WT operation, signals of 384 picture 
elements subjected to 2:1 sub sampling are stored with 
1 line period as a period. Meanwhile, RD operation is 
performed by the synchronizing system of the signal S1 . 
A signal (O l in figure) of the signal S1 is read at an 
earlier half of 1 line, and a signal (O r in figure) of the 
signal SV is read in a later half thereof. Output signals 
which have been subjected to horizontal (H) synchroni- 
zation are provided by the RD operation. Incidentally, 
similar to cut mode, phase shift in vertical synchroniza- 
tion is corrected by signal processing of vertical syn- 
chronization at a vertical scaling unit 6, mentioned later. 

Fig. 15B shows operation of the memories 71 in 
PIP display. In this case, a main picture is constituted by 
picture of the signal S1 . and a sub picture is constituted 
by picture of cinema mode formed by compressing pic- 
ture of the signal SV by 1/3. Therefore, according to WT 
operation, all of 768 effective picture elements of the 
signal S1 are stored with 1 line as a period. Further, in 
respect of the signal SV, a signal of 128 picture ele- 
ments which has been subjected to 6:1 sub sampling is 
stored. Meanwhile, RD operation is performed by the 
synchronizing system of the signal S1 , in which the 768 
picture elements signal of the signal S1 is read from the 
front of 1 line and the 128 picture elements signal of the 
signal SV is read successively. Output signals which 
have been subjected to horizontal synchronization are 
provided by the RD operation. Further, phase shift of 
vertical synchronization is corrected by signal process- 
ing of vertical synchronization at a vertical scaling unit 
6, mentioned later. 

Fig. 1 6A shows content of signal processing of hor- 
izontal and vertical scaling units 5 and 6 in double win- 
dows and PIP display, Fig. 16B shows an outline view of 
vertical synchronization and Fig. 16C shows an outline 
of the operation of a memory in vertical synchronization, 
respectively. 

As shown by Fig. 1 6A, in cut mode of double win- 
dows, the horizontal scaling unit 5 performs processing 
of 4-3 line number compression conversion and the ver- 
tical scaling unit 6 performs processing of vertical syn- 
chronization. Further, in full mode, the vertical scaling 
unit 6 performs processing of 3-2 line number compres- 
sion conversion and vertical synchronization. Mean- 
while, in PIP display, the horizontal scaling unit 5 
performs 4-3 line number compression conversion in 
respect of a main picture, processing of 1-2 line number 
expansion conversion in respect of a sub picture and 
the vertical scaling unit 6 performs processing of 9-4 
line number compression conversion and vertical syn- 
chronization in respect of the sub picture. Further, in 
respect of one window display, processing similar to that 
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in the first embodiment mentioned above is carried out 

As shown by Fig. 16B, although the signals which 
have been subjected to horizontal synchronization are 
inputted to the horizontal and vertical scaling units 5 
and 6. a phase of vertical synchronization is shifted 
between the signal S1 and the signal SV and causes 
vertical synchronizing gap. Therefore, the phase of ver- 
tical synchronization of the signal SV is made to coin- 
cide with that of the signal S1 by processing of vertical 
synchronization. 

As shown by Fig. 16C. in cut mode, through 
processing is carried out to a signal (earlier half of each 
line) of the signal S1 . Meanwhile, a signal (later half of 
each line) of the signal SV is stored to the memory 71 
by WT operation. Further, RD operation is performed by 
the synchronization system of the signal S1 and a signal 
which has been subjected to vertical synchronization is 
read. Incidentally, as memory capacity necessary for 
the signal processing, a capacity of 1 field period is suf- 
ficient at maximum. 

According to full mode, in WT operation, a signal 
(earlier half of each line) of the signal S1 formed by 3-2 
line number conversion and a signal (later half of each 
line) of the signal SV are intermittently written and 
stored. Meanwhile, in RD operation, both of reading of 
the signal (earlier half of each line) of the signal S1 and 
reading of the signal (later half of each line) of the signal 
S1 ' are performed by the synchronizing system of the 
signal S1. Thereby, a signal having vertical synchroni- 
zation is provided. Incidentally, as memory capacity 
necessary for the signal processing, a capacity of 1/3 
(as mentioned before, K=3, L=2 in (1-L/K)) field period 
is sufficient for vertical compression and 1 field period in 
vertical synchronization at maximum. 

As mentioned above, according to the embodiment, 
a method and a circuit for signal processing of format 
conversion of picture signal having both functions of 
double windows and PIP display, can be realized with 
inconsiderable deterioration of picture quality accompa- 
nied by signal processing and with an extremely small 
memory capacity for use at low cost. 

(Embodiment 4) 

Fig. 1 7 shows a fourth embodiment of a format con- 
version circuit of picture signal according to the present 
invention. The embodiment is provided with the consti- 
tution similar to that in Embodiment 3. In constituting a 
sub picture for PIP display by processing the signal SV, 
although 6:1 sub sampling is performed in the case of 
Embodiment 3 in respect of the sampling operation, 
according to Embodiment 4, the sampling is constituted 
by 3:1 sub sampling by which a number of picture ele- 
ments is increased. The embodiment is preferable in the 
case where the functions of performing double windows 
and PIP display are also realized similar to Embodiment 
3. A multi processing unit 73 is a processing unit for car- 
rying out such a sub sampling. Portions in Fig. 17 hav- 



15 



20 



25 



30 



35 



40 



45 



50 



15 



29 



EP 0 837 601 A2 



30 



ing the constitution and function the same as those in 
Fig. 1 are attached with notations the same as those in 
Fig. 1 and a detailed explanation will be omitted. 

The first input picture signal S1 (comprising compo- 
nent luminance and color difference signals of 42:2 
system or 4:2:0 system) is inputted to the multi process- 
ing unit 73 and the selector 67. Further, a second input 
picture signal SV (comprising component luminance 
and color difference signals of 455 system or 4:2:0 
system) is inputted to the multi processing unit 73. The 
multi processing unit 73 performs signal processing of 
multiplexing the first and the second picture signals S1 
and SV into a time division multiplex signal which forms 
a signal for double windows and a signal of the sub pic- 
ture for PIP display. TTie selector 67 outputs the first pic- 
ture signal S1 in one window mode and a signal 
outputted from the multi processing unit 73 in double 
windows. 

Fig. 18 is a view for explaining formation of the sub 
picture signal for PIP display at the multi processing unit 
73. 

According to PIP display, a main picture is consti- 
tuted by the picture of the signal S1 and the sub picture 
is constituted by a picture of cinema mode formed by 
compressing the picture of the signal SV by 1/3. 
Accordingly, a signal of 256 picture elements provided 
by performing 3:1 sub sampling to the signal SV is 
stored to the memory 71 by WT operation with 1 line 
period as a period in a synchronizing system of the sig- 
nal SV. Meanwhile, according to RD operation, a signal 
is read at a speed twice as much as that of WT opera- 
tion by the synchronizing system of the signal S1. 
Thereby, a sub picture signal PIP in a mode of progres- 
sive scanning having horizontal synchronization of the 
signal S1 is formed. The signal PIP is subjected to 
processing of 9-4 line number compression conversion 
and vertical synchronization at the vertical scaling unit 6 
by which the sub picture of cinema mode is constituted. 
Incidentally, except signal processing in PIP display, the 
constitution and signal processing of the embodiment 
are similar to those in Embodiment 3 and an explana- 
tion thereof wilt be omitted. 

As mentioned above, according to Embodiment 4, a 
method and a circuit for signal processing of format con- 
version of picture signal having both functions of double 
windows and PIP display, can be realized with inconsid- 
erable deterioration of picture quality accompanied by 
signal processing and an extremely small memory 
capacity for use at low cost. 

According to the present invention, a method and a 
circuit for signal processing of format conversion of pic- 
ture signal for converting a plurality of formats of picture 
signals into picture signals of predetermined display for- 
mats of picture output devices or performing scaling 
processing of flexible expansion and compression in the 
horizontal and the vertical directions of picture, can be 
realized with inconsiderable deterioration of picture 
quality accompanied by signal processing and an 



extremely small memory capacity for use at low cost. 
Therefore, a significant effect is achieved in promoting 
function of various information device terminals in corre- 
spondence with multimedia and reduction in cost. 
5 It is further understood by those skilled in the art 

that the foregoing description is a preferred embodi- 
ment of the disclosed device and that various changes 
and modifications may be made in the invention without 
departing from the spirit and scope thereof. 

10 

Claims 

1 . A signal processing circuit for converting the format 
of an input picture signal into a predetermined dis- 

75 play format of a picture output device, said circuit 
comprising: 

a scanning converter for performing a first local 
signal processing of converting the input pic- 
20 ture signal into a progressive scanning picture 

signal when the input picture signal is of inter- 
lace scanning; 

a first selector for selecting the input picture 
signal or the picture signal outputted by the 

25 scanning converter; 

a scaling unit comprising a horizontal scaling 
unit for performing a second local signal 
processing of compression and expansion in a 
horizontal direction on the signal selected by 

30 the first selector and a vertical scaling unit per- 

forming third local signal processing of com- 
pression and expansion in a direction vertical 
thereto; and 

a control unit for selecting signal processing 
35 parameters in accordance with the format of 

the input picture signal and the display format 
of the picture output device and controlling at 
least the scanning converter, the first selector 
and the scaling unit in accordance with the sig- 
40 nal processing parameters. 

2. The circuit of claim 1, wherein the scanning con- 
verter comprises: 

45 a first converter for converting the input picture 

signal into a transmission scanning line signal 
transmitted in interlace scanning and an inter- 
polation scanning line signal formed by interpo- 
lating scanning lines skipped in interlace 

so scanning when the input picture signal is of 

interlace scanning; and 

a multiple-scan converter for multiplexing the 
transmission scanning line signal and the inter- 
polation scanning line signal to form a progres- 
55 srve scanning signal by a fifth local signal 

processing of time-division multiplex with a 
compression of the time axis by 1/2. 
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3. The circuit of claim 2, wherein the first converter 
comprises: 

a motion detector for detecting a picture motion 
coefficient of the input picture signal; s 
a circuit for constituting first and second inter- 
polation signals by performing an intrafield cal- 
culation and an interfield calculation, 
respectively, on the input picture signal; and 
a circuit for providing the interpolation scanning io 
line signal by varying the mixture ratio of the 
first and second interpolation signals by the 
motion coefficient. 

4. The circuit of claim 1, wherein the horizontal scaling is 
unit comprises: 

a low pass filter for removing aliasing noise 
from the input signal to the horizontal scaling 
unit; 20 
a 1 -horizontal scanning line memory; 
a first switch for selecting the output signal of 
the 1 -horizontal scanning line memory or the 
output signal of the low pass fitter; 
a calculation unit for delaying the output signal 25 
of the first switch by one picture element 
period, forming a first signal by multiplying the 6. 
delayed signal by a coefficient p (1 > p £ 0), 
forming a second signal by multiplying the out- 
put signal of the first switch by a coefficient 1 -p. 30 
and adding the first and second signals; 
a second switch for selecting either the input 
signal to the horizontal scaling unit or the out- 
put signal of the calculation unit, and inputting 
the selected signal to the 1 -horizontal scanning 35 
line memory; 7. 
a third switch for selecting the output signal of 
the 1 -horizontal scanning line memory or the 
output signal of the calculation unit; and 
a fourth switch for selecting the output signal of 40 
the third switch or the input signal to the hori- 
zontal scaling unit; 

wherein signal processing by compres- 8. 
sion in a horizontal direction, expansion in a 
horizontal direction or through processing is 45 
selectively performed by selective control of the 
switches. 



delaying the output signal of the first switch by 
one line period and multiplying the delayed out- 
put signal by a coefficient p (1 > p £ 0), forming 
a second signal by multiplying the output signal 
of the first switch by a coefficient 1-p. and add- 
ing the first and second signals: 
a second switch for selecting the input signal to 
the vertical scaling unit or the output signal of 
the calculation unit, and inputting the selected 
signal to the first field memory; 
a second field memory for delaying the output 
signal of the calculation unit; 
a third switch for selecting the signals outputted 
by the calculation unit, an output signal read 
from the first field memory or an output signal 
read from the second field memory; and 
a fourth switch for selecting the output signal of 
the third switch or the input signal to the vertical 
scaling unit; 

wherein signal processing by compres- 
sion in a vertical direction, expansion in a verti- 
cal direction, through processing, field multiple- 
scanning or PAL-NTSC system conversion is 
selectively performed by selective control of the 
switches. 

The circuit of claim 1 , wherein the horizontal scaling 
unit and the vertical scaling unit comprise circuits 
for performing the second local signal processing of 
compression in a horizontal direction and expan- 
sion in a horizontal direction, and the third local sig- 
nal processing of compression in a vertical 
direction and expansion in a vertical direction, 
respectively, by linear interpolation. 

Trie circuit of claim 1, wherein a picture quality 
improving unit controlled by the control unit is con- 
nected to an output terminal of the scaling unit for 
performing signal processing by colour space con- 
version and/or inverse gamma conversion on the 
output signal of the scaling unit. 

The circuit of claim 7, wherein a multiplex unit con- 
trolled by the control unit is connected to an output 
terminal of the picture quality improving unit for mul- 
tiplexing another display picture signal with the out- 
put signal of the picture quality improving unit. 



The circuit of claim 1 , wherein the vertical scaling 
unit comprises: so 

a low pass filter for removing aliasing noise 
from the input signal to the vertical scaling unit; 
a first field memory; 

a first switch for selecting an output signal read 55 
from the first field memory or the output signal 
of the tow pass filter; 

a calculation unit for forming a first signal by 



9. The circuit of claim 1 , further comprising: 

a colour signal multiplex unit for multiplexing 
two colour difference signals of the input pic- 
ture signal to form a time-division multiplex sig- 
nal; 

wherein the time-division multiplex sig- 
nal outputted by the colour multiplex unit is 
inputted to the scanning converter and the first 
selector. 
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10. The circuit of claim 1 , further comprising: 

a multi-processing unit for inputting first and 
second picture signals having the same format 
and for performing fourth local signal process- s 
ing of multiplexing the first and second picture 
signals to form a time-division multiplex signal 
during one scanning line period; and 
a second selector for constituting the input pic- 
ture signal by selecting the first picture signal or 10 
the time-division multiplex signal outputted by 
the multi-processing unit; 

wherein the control unit is constituted to 
have the scanning converter, the first selector 
and the scaling unit perform the signal process- is 
ing on the first picture signal in case of one win- 
dow display, and on the time-division multiplex 
signal outputted by the multi-processing unit in 
case of double windows. 



20 

11. The circuit of claim 10, wherein the multi-process- 
ing unit comprises: 



Delation scanning line signal to a progressive 
scanning signal by a fifth local signal process- 
ing of time-division multiplex with a compres- 
sion of the time axis by 1/2. 

1 3. A signal processing circuit for converting the format 
of an input picture signal into a predetermined dis- 
play format of a picture output device, said circuit 
comprising: 

a first converter for converting the input picture 
signal into a transmission scanning line signal 
transmitted in interlace scanning and an inter- 
polation scanning line signal formed by interpo- 
lating scanning lines skipped in interlace 
scanning when the input picture signal is of 
interlace scanning; 

a second converter for converting the input pic- 
ture signal into a transmission scanning line 
signal transmitted in interlace scanning and an 
interpolation scanning line signal formed by 
interpolating scanning lines skipped in inter- 
lace scanning when the input picture signal is 
of progressive scanning; 
a third selector for selecting a set of the trans- 
mission scanning line signal and the interpola- 
tion scanning line signal outputted by the first 
converter or a set of the transmission scanning 
line signal and the interpolation scanning line 
signal outputted by the second converter; 
a scaling unit comprising a horizontal scaling 
unit for performing a second local signal 
processing of compression in a horizontal 
direction and expansion in a horizontal direc- 
tion on each signal selected by the third selec- 
tor and a vertical scaling unit for performing a 
third local signal processing of compression in 
a vertical direction and expansion in a direction 
vertical thereto; 

a multiple-scan converter for converting signals 
outputting from the scaling unit into a progres- 
sive scanning signal by a fifth local signal 
processing of time-division multiplex with com- 
pression of the time axis by 1/2; and 
a control unit for selecting signal processing 
parameters in accordance with the format of 
the input picture signal and the predetermined 
display format of the picture output device, and 
controlling at least the first converter, the sec- 
ond converter, the third selector, the scaling 
unit and the multiple-scan converter in accord- 
ance with the parameters. 

14. The circuit of any one of claims 1, 10 and 13, 
wherein the horizontal scaling unit comprises a cal- 
culation unit for multiplying a plurality of picture ele- 
ments by coefficient values, a line memory and a 
plurality of switches, wherein a signal processing by 



a first filter for removing aliasing noise from the 
first picture signal; 25 
a first sampling unit for sub-sampling the output 
signal of the filter; 

a fourth selector for selecting the output signal 
of the first sampling unit or the first picture sig- 
nal; 30 
a first line memory connected to an output ter- 
minal of the fourth selector; 
a second filter for removing aliasing noise from 
the second picture signal; 

a second sampling unit for sub-sampling the 35 

output signal of the second filter; 

a fifth selector for selecting the output signal of 

the second sampling unit or the second picture 

signal; 

a second line memory connected to an output 40 
terminal of the fifth selector; and 
a multiplex unit for multiplexing the output sig- 
nal of the first line memory with the output sig- 
nal of the second line memory to form a time- 
division multiplex signal. 45 

12. The circuit of claim 10, wherein the scanning con- 
verter comprises: 

a first converter for converting the input picture so 
signal into a transmission scanning line signal 
transmitted in interlace scanning and an inter- 
polation scanning line signal formed by interpo- 
lating scanning lines skipped in interlace 
scanning when the input picture signal is of ss 
interlace scanning; and 

a multiple-scan converter for multiplexing the 
transmission scanning line signal and the inter- 



18 



35 

compression in a horizontal direction, expansion in 
a horizontal direction or through processing is 
selectively performed by selective control of the 
switches. 

5 

15. The circuit of any one of claims 1. 10 and 13. 
wherein the vertical scaling unit comprises a calcu- 
lation unit for multiplying picture elements in a plu- 
rality of lines by coefficient values, field memories 
and a plurality of switches, wherein a signal 10 
processing by compression in a vertical direction, 
expansion in a vertical direction or through process- 
ing is selectively performed by selective control of 
the switches. 

15 

16. The circuit of any one of claims 1, 10 and 13, 
wherein the horizontal scaling unit is a circuit for 
performing only the signal processing by compres- 
sion in a horizontal direction and through process- 
ing, and the vertical scaling unit is a circuit for 20 
performing the third local signal processing on the 
output signal of the horizontal scaling unit. 

17. The circuit of any one of claims 1. 10 and 13, 
wherein the horizontal scaling unit is a circuit for 25 
performing only the signal processing of expansion 

in a horizontal direction and through processing on 
the output signal of the vertical scaling unit. 

18. A television receiver comprising: 30 

the signal processing circuit of any preceding 
claim; and 

a picture output device for displaying the pic- 
ture of the output signal of the signal process- 35 
ing circuit. 

19. A signal processing method for converting the for- 
mat of an input picture signal into a predetermined 
display format of a picture output device, compris- 40 
ing the steps of: 

providing a progressive scanning picture signal 
directly from the input picture signal when the 
input picture signal is of progressive scanning 45 
and providing a progressive scanning picture 
signal by converting the input picture signal into 
a progressive scanning picture signal when the 
input picture signal is of interlace scanning; 
and 50 
performing a scaling operation of compression 
in a horizontal direction, expansion in a hori- 
zontal direction, compression in a vertical 
direction, expansion in a vertical direction 
and/or frame rate conversion on the provided ss 
progressive scanning picture signal in accord- 
ance with the format of the input picture signal 
and the predetermined display format of the 



36 

picture output device. 

20. The method of daim 15, wherein the compression 
in the horizontal direction, the expansion in the hor- 
izontal direction, the compression in the vertical 
direction, and the expansion in the vertical direction 
are performed by linear interpolation with multiply- 
ing coefficients on signals of a pair of picture ele- 
ments contiguously arranged in the horizontal 
direction and in the vertical direction, respectively, 
and adding the products thereof. 

21. The method of claim 19. wherein signal processing 
by colour space conversion and/or inverse gamma 
conversion is performed on a picture signal which 
has been subjected to the scaling operation. 

22. The method of claim 19, wherein the input picture 
signal is a 4:2:2 or 4:2:0 component signal compris- 
ing a luminance signal and colour difference sig- 
nals. 

23. The method of claim 19, comprising the further 
steps of: 

performing signal processing of multiplexing 
first and second picture signals having the 
same format on a time-division multiplex signal 
during one scanning line period; and 
constituting the input picture signal by selecting 
the first picture signal or the time-division multi- 
plex signal. 

24. The method of claim 19 or 23, wherein, in perform- 
ing the scaling operation, when the scaling opera- 
tion of compression in the horizontal direction is 
performed, the scaling operation of compression in 
the vertical direction or expansion in the vertical 
direction is performed after the scaling operation in 
the horizontal direction, and when the scaling oper- 
ation of expansion in the horizontal direction is per- 
formed, the scaling operation of expansion in the 
horizontal direction is performed after the scaling 
operation of compression in the vertical direction or 
expansion in the vertical direction. 
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FIG. 16B 
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FIG. 20C 
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FIG. 22 
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